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Abstract 

We consider a Gaussian sequence model that contains ill-posed inverse problems as special 
cases. We assume that the associated operator is partially unknown in the sense that its 
singular functions are known and the corresponding singular values are unknown but observed 
with Gaussian noise. For the considered model, we study the minimax goodness-of-fit testing 
problem. Working with certain ellipsoids in the space of squared-summable sequences of 
real numbers, with a ball of positive radius removed, we obtain lower and upper bounds 
for the minimax separation radius in the non-asymptotic framework, i.e., for fixed values 
of the involved noise levels. Examples of mildly and severely ill-posed inverse problems 
with ellipsoids of ordinary-smooth and super-smooth sequences are examined in detail and 
minimax rates of goodness-of-fit testing are obtained for illustrative purposes. 
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1 Introduction 


We consider the following Ganssian sequence model (GSM), 

j ^ 2 ^^ 

Xj = bj +ar]j, j e N, 

where N = {1,2,...} is the set of natural numbers, b = {bj}j^fq > 0 is an unknown se¬ 
quence, 6 = € Z^(N) is the unknown signal of interest, ^ rj = {r/jjieN 

are sequences of independent standard Gaussian random variables (and independent of each 
other), and e, a > 0 are known parameters (the noise levels). The observations are given 
by the sequence {Y,X) = {(Y)-, Xj)}jgp| from the GSM (11.111 and their joint law is denoted 
by Pe fo. Here, P{N) denotes the space of squared-summable sequence of real numbers, i.e., 
i2{N) = {9 € R" : ||9||2 := < +°o). 

The GSM (jl.lll arises in the case of ill-posed inverse problems with noisy operators. Indeed, 
consider the Gaussian white noise model (GWNM) 

dYe{t) = Af{t)dt + edW{t), t£V, ( 1 . 2 ) 

where H is a linear bounded operator acting on a Hilbert space Tdi with values on another Hilbert 
space "^ 2 , /(•) G Tdi is the unknown response function that one wants to detect or estimate, 
W{-) is a standard Wiener process on H CM, and e > 0 is a known parameter (the noise level). 
For the sake of simplicity, we only consider the case when A is injective (meaning that A has a 
trivial nullspace) and assume that V = [0,1], Tii = L^([0,1]), U CM and 'H 2 = L‘^{U). In most 
cases of interest, H is a compact operator (see, e.g.. Chapter 2 of m)- In particular, it admits 
a singular value decomposition (SVD) {bj,'ipj,ipj)j^fq, in the sense that 

A(pj = bjipj, A^il^j = bjipj, j € N, (1.3) 

where A* denotes the adjoint operator of H - here {b‘j)j^^ and are, respectively, the 

eigenvalues and the eigenfunctions of A*A. Thus, the (first equation in) GSM (|l.ll) arises where 
for all j G N 

^Pj{t)dW{t), }gN, 

and b^ > 0 (since A is injective). In this case, the GWNM (11.211 corresponds to a so-called 
ill-posed inverse problem since the inversion of A* A is not bounded. Possible examples of such 
decompositions arise with, e.g., convolution or Radon-transform operators, see, e.g., [10]. The 
effect of the ill-posedness of the model is clearly seen in the decay of the singular values bj as 
j —>■ -|-oo. As j —>■ -l-oo, bjOj gets weaker and is then more difficult to perform inference on the 
sequence 9 = 


Yi = 


[ tpj{t)dY^{t), Oj = [ <pj{t)f{t)dt, (j = [ 
Jo Jo Jo 


In the early literature, the compact operator A (and, hence, its sequence b = of 

singular values) was supposed to be fully known. (Note that, in this case, the second equation 
in the GSM (|l.lll does not appear.) We refer, e.g., to [3], [5], [1], [7j, [8] (minimax estimation) 
and to m, m (minimax signal detection/minimax goodness-of-fit testing). Therein, minimax 
rates/oracle inequalities (estimation) and minimax separation radius/minimax separation rates 
(signal detection or goodness-of-fit testing) were established, amongst other investigations, for 
ill-posed inverse problems with smoothness conditions on the sequence of interest. 

The case of an unknown compact operator A that is observed with Gaussian noise has also 
been recently treated in the estimation literature, especially the situation where A is partially 
unknown, see, e.g., [6], |9|, [I3j. In these contributions, it is assumed for the corresponding SVD 
()1.3p that 
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• the sequence of singular functions is known, 

• the sequence of singular values b = {bj}j^fq is unknown but observed with some Gaussian 
noise. 

In other words, the following sequence model is considered 

Xj = bj +ar]j, j G N, 

where rj = {r]j}j^^ is a sequence of independent standard Gaussian random variables (and inde¬ 
pendent of the standard Gaussian sequence ^ and u > 0 is a known parameter (the 

noise level). Therefore, the second equation in the GSM (II.ip is also readily available. 

To practically motivate the GSM consider the following deconvolution model (see also 

[6] for a complete discussion on this snbject) 

dY,{t)=g*f{t) + EdW{t), tG[0,l], (1.4) 

where ^ 

- x)f{x)dx, tG[0,1], 

Jo 

is the convolution between g(-) and f{-), g{-) is an unknown 1-periodic (convolution) kernel 
in i"([0.11), /(■) is an nnknown 1-periodic signal in L^([0,1]), dY^{-) is observed, W{-) is a 
standard Wiener process, and e > 0 is the noise level. Let j G N, be the usual real 

trigonometric basis on V. The model (11.41) is equivalent to the (first equation in the) GSM 
dni by a projection on the trigonometric basis 4>j{-), j G N. In the case where the kernel 
g{-) is nnknown (i.e., the sequence {bk)kef>i = {{d, 4>k))k£N is unknown), suppose that we can 
pass the trigonometric basis j G N, through the convolution kernel, i.e., to send each 

j G N, as an input function /(•) and observe the corresponding dY^j{-), j G N. In other 
words,we are able to obtain training data for the estimation of the unknown convolution ker¬ 
nel g{-) in this setting. In particular, we obtain exactly the two sequences of observations Yj 
and Xj, j G N, in the GSM (HI]). In this case, the corresponding noise levels coincide, i.e., s = a. 

To the best of our knowledge, there is no research work on minimax goodness-of-fit testing 
in ill-posed inverse problems with partially unknown operators. Onr aim is to fill this gap. In 
particular, considering model (jl.ip and working with certain ellipsoids in the space of squared- 
summable sequences of real numbers, with a ball of positive radius removed, we obtain lower 
and upper bounds for the minimax separation radius in the non-asymptotic framework, i.e., 
for fixed values of e and a. Examples of mildly and severely ill-posed inverse problems with 
ellipsoids of ordinary-smooth and super-smooth sequences are examined in detail and minimax 
rates of goodness-of-fit testing are obtained for illustrative purposes. 

The paper is organized as follows. Section [2] presents the considered statistical setting and a 
brief overview of the main results. Section [3] is devoted to the construction of the suggested test¬ 
ing procedure. A general upper bound on the maximal second kind error is then displayed and 
special benchmark examples are presented for illnstrative purposes. The corresponding lower 
bounds are proposed in Section H Some concluding remarks and open questions are discnssed 
in Section [SJ Finally, all proofs and technical arguments are gathered in Section El 

Throughout the paper we set the following notations. For all x,y & M., 6x{y) = 1 ii x = y 
and dx{y) = 0 if x 7 ^ y. Also, x Ay := min{x, y} and xV y := max{x, y}. Given two sequences 
(cj)jgN and {dj)j^f^ of real numbers, Cj ~ dj means that there exists 0 < kq < < 00 such that 

kq < Cj/dj < Ki for all j G N. Let n be either e or a or (e, a), and let V be either := (0, -|-oo) 
or M+ X R+. Given two collections and {d^)u£V of positive real numbers, c^, > dy means 

that there exists 0 < kq < +00 such that Cy > kq dy for all z/ G V. Similarly, Cy < dy means that 
there exists 0 < ki < -|-oo such that Cy < ki dy for all z/ G V. 


3 


2 Minimax Goodness-of-Fit Testing 

2.1 The Statistical Setting 

Given observations {Y,X) = {(1^-, from the GSM (II.ip . the aim is to compare the 

underlying (unknown) signal 6 E ^^(N) to a (known) benchmark signal Oq, i.e., to test 

Ho-.6 = 00 versus Hi-.O-OoeF, (2.1) 

for some given Oq and a given subspace F. The statistical setting m is known as goodness-of-fit 
testing when 0o 7 ^ 0 or signal detection when Oq = 0. 


Remark 2.1 Given observations from the GWNM ()1.2p . the testing problem m is equivalent 
to 

Hq: f = fo versus Hi : f - fo e F, 

for a given benchmark function fo and a given subspace F. In most cases, F contains functions 
/ E L^([0,1]) that admit a Fourier series expansion with Fourier coefficients 9 belonging to F 
(see, e.g., m, Section 3.2.). 

The choice of the set F is important. Indeed, it should be rich enough in order to contain 
the true 9. At the same time, if it is too rich, it will not be possible to control the performances 
of a given test due to the complexity of the problem. The common approach for such problems 
is to impose both a regularity condition (which characterizes the smoothness of the underlying 
signal) and an energy condition (which measures the amount of the underlying signal). 

Goncerning the regularity condition, we will work with certain ellipsoids in P{N). In partic¬ 
ular, we assume that 9 E £a{R), the set £a{R) being defined as 

£a{R) = \9^ l\n), Y. ap] < R i , (2.2) 

where a = {aj)j^jq denotes a non-decreasing sequence of positive real numbers with aj —>■ -|-oo 
as j —)• -|-oo, and R > 0 is a constant. The set £a{R) can be seen as a condition on the decay of 
9. The cases where a increases very fast correspond to 9 with a small amount of non-zero coef¬ 
ficients. In such a case, the corresponding signal can be considered as being ‘smooth’. Without 
loss of generality, in what follows, we set R = 1 , and write £a instead oi £a{l)- 

Regarding the energy condition, it will be measured in the /^(N)-norm. In particular, given 
G,(t > 0 (called the radius), which is allowed to depend on the noise levels e, cr > 0 , we will 
consider 9 G £a such that ||0|| > r^^^- Given a smoothness sequence a and a radius r^^^ > 0, the 
set F can thus be defined as 

F := 0a(r.,a) = {9g £a, ||0|| > . (2.3) 

In other words, the set F is an ellipsoid in /^(N) with a ball of radius r^^a > 0 removed. In many 
cases of interest, the set F provides constraints on the Fourier coefficients of / E L^([0,1]) in 
the model (11.21) (see, e.g., [12], Section 3.2). 

We consider below the hypothesis testing setting ()2.1I) with 9o ^ 0 (i.e., goodness-of-fit 
testing). Formally, given observations from the GSM (|l.lll . for any given 9o 7 ^ 0, we will be 
dealing with the following goodness-of-fit testing problem 

Ho:9 = 9o versus Hi : 0o G £a, 9 - 9o G &aire,a), (2.4) 
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where 0a(r£,o-) is defined in (|2.3I) . The sequence a being fixed, the main issue for the problem 
(|2.4p is then to characterize the values of > 0 for which both hypotheses Hq (called the null 
hypothesis) and Hi (called the alternative hypothesis) are ‘separable’ (in a sense which will be 
made precise later on). 


Remark 2.2 We would like to stress that in the standard GSM (i.e., dni with cr = 0), sig¬ 
nal detection (i.e., Oq = 0) and goodness-of-fit testing (i.e., Oq ^ 0) problems are equivalent 
as soon as the involved operator is injective. Indeed, without loss of generality, we can still 
replace the observed sequence (l^)jgN by (l^)jgisj := (Y)- — 6j0oj)igN- This is no more the case 
in the GSM (|l.ll) since the sequence {hj)j^fi is unknown. Signal detection and goodness-of-fit 
problems should therefore be treated in a different manner. In this work, we only address the 
goodness-of-fit testing problem (|2.4p . 


In the following, a (non-randomized) test T := T(y, X) will be dehned as a measurable 
function of the observation {Y,X) = {Yj,Xj)j^fi from GSM (jl.ip having values in the set {0,1}. 

By convention, Hq is rejected if T = 1 and Hq is not rejected if T = 0. Then, given a test T, 
we can investigate 

• the first kind error probability defined as 

Q£,^(T) := P0o,b(T = 1), (2.5) 

which measures the probability to reject Hq when Hq is true (i.e., 6 = 9q); it is often 
constrained as being bounded by a prescribed level a €] 0 , 1 [, and 

• the maximal second kind error probability defined as 

/ 3 £,ff( 0 a(r-£,, 7 ),^') := sup P 0 ,b(T = 0 ), (2.6) 

9o^£a,S — 9o€&a(re,rT) 

which measures the worst possible probability not to reject Hq when Hq is not true (i.e., 
when 6*0 G £a and 6 * — 0 o G one would like to ensure that it is bounded by a 

prescribed level /3 g] 0 , 1 [. 

For simplicity in our exposition, we will restrict ourselves to a-level tests, i.e., tests Tq, sat¬ 
isfying Q;£^o-('I'a) < a, for any fixed value a g] 0 , 1 [. 

Let a,/3 g] 0, 1[ be given, and let Tq, be an a-level test. 

Definition 2.1 The separation radius of the a-level test Tq over the class £a is defined as 
re,a{£a, ■= mf {r^^a > 0 : l3^^„{Qa{re,a), ^a) < fi} , 

where the maximal second kind error probability (3^ ^{Qai'>'e,rT),^a) is defined in f2.6\} . 

In some sense, the separation radius r^^„{£a, 'Lq, /3) corresponds to the smallest possible value 
of the available signal ||0 — 6 *o|| for which Hq and Hi can be ‘separated’ by the a-level test 
with maximal second kind error probability, bounded by a prescribed level j3 g]0, 1[. 

Definition 2.2 The minimax separation radius := 'he,a{£a,cx, /3) > 0 over the class £a is 
defined as 

fe,a'-=, inf_ re,cr(^a,^a,/3). (2.7) 

The minimax separation radius r^^a corresponds to the smallest radius > 0 such that 
there exists some a-level test Tq, for which the maximal second kind error probability o-( 0 a(^£,o-)) 'I'a) 
is not greater than /3. 
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2.2 Summary of the Results 

Our aim is to establish ‘optimal’ separation conditions for the goodness-of-ht testing problem 
(I22D. This task requires, in particular, precise (non-asymptotic) controls of the hrst kind error 
probability Q:£^o-('I'a) and the maximal second kind error probability ,^(0a(re^o-),(of a 
specihc test Tq, that will be made precise in Section [3]) by prescribed levels a,f3 e] 0, 1[, respec¬ 
tively. Such controls allow us to derive both upper and lower bounds on the minimax separation 
radius as summarized in the following theorem. 


Theorem 2.1 Let a,f3 E]0, 1[ be fixed, such that a < fi. Consider the goodness-of-fit testing 
problem i2.4\ )- Then, there exist explicit positive constants^ C{a,f3) > 0, Ca,i 3 > 0, > 0 and 

(To €]0,1[ such that, for all 0 < u < uq and for each e > 0, 


{i) rl„< inf 
DeN 


and, for all £,a > 0, 


C{a,fi)e^ 


DAMi 


. ^ bj + {7 + 4v^ln(2/Q;)) (T^ ln^/^(l/(T) V a 

\ i=i 


-2 

DAMo 


(ii) > 




a,l3 2 





sup 

^ A 

1 

F>eN 



D 


16 i<d<M 2 ^ 
where the bandwidths Mq,Mi and M 2 depend on both and a. 






Theorem 12.11 provides a precise description on the behavior of the minimax separation radius 
in terms of the sequences and (6j)jeN and of the noise levels e and a. It is worth 

pointing out that this control is non-asymptotic. There is indeed a technical constraint on the 
value of (T (0 < (T < do, ctq g] 0, 1[), but we do not assume its convergence towards 0, i.e., we 
work with fixed values of the noise levels e and ci. 


Then, we apply the above result on specihc problems. Namely, we consider various behaviors 
for both sequences and and discuss the properties of the associated minimax sep¬ 

aration radii Concerning the eigenvalues {b‘j)j£^ of the operator A*A, we will alternatively 
consider situations where 

bj ~ or bj ~ exp(—jt), Vj G N, for some t > 0. 

The hrst case corresponds to the so-called mildly ill-posed problems while the second one cor¬ 
responds to severely ill-posed problems. Concerning the ellipsoids £a, i.e., the sequence (oj)jeN) 
two different kinds of smoothness will be investigated, namely, 

Oj ~ or Oj ~ exp(js), Vj G N, for some s > 0, 

the so-called ordinary-smooth and super-smooth cases, respectively. In the above scenarios, we 
apply Theorem 12.11 and describe the associated upper and lower bounds on the minimax sepa¬ 
ration radius r^^„. They are, respectively, displayed in Table ITT] and Table [221 


Looking at these tables, both lower and upper bounds coincide in every considered case, up 
to a logarithm term that depends on the noise level a. Hence, Theorem 12.11 provides a sharp 

^For the sake of brevity, these quantities are made precise in the subsequent sections 
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Goodness-of-Fit 

ordinary-smooth 

super-smooth 

Testing Problem 

aj ~ f 

aj ~ exp{js} 

mildly ill-posed 
bj ~ i"* 

^As/{2s+2t+l/2) ^ 

e^(ln(l/e))^*'''^/^ V cr^ ln^/^(l/cT) 

severely ill-posed 
bj ~ exp{-jf} 

(ln(l/e))-2* V [ln(l/cjln-i/2(l/cT))]-2* 

^2s/{s+t) [(jlnl/2(l/cr)]2KVdAl| 


Table 2.1: Minimax goodness-of-fit testing with unknown singular values: upper bounds on the 
minimax separation radius for 0 < e < SQ) £]0, 1[, and 0 < ct < uo, (Tq G]0, 1[, for all 
t,s > 0. 


Goodness-of-Fit 
Testing Problem 

ordinary smooth 

super smooth 
aj ~ exp{js} 

mildly ill-posed 
bj ~ j-* 

^4s/(2s+2t+l/2) y ^2[(s/t)Al\ 


severely ill-posed 
bj ~ exp{-jf} 

(ln(l/e))-2^ V(ln(l/u))-2^ 

^2s/{s-et} Y ^2\{s/t)M\ 


Table 2.2: Minimax goodness-of-fit testing with unknown singular values: lower bounds on the 
minimax separation radius for 0 < e < eo) £]0,1[, and 0 < ct < uo, uq G]0, 1[, for all 
t,s > 0. 


control on the minimax separation radius in various settings. The interesting property of 
such minimax separation radii is that they have the same structure whatever the considered 
situation: a maximum between two terms depending, respectively, on the noise levels e and a. 
It is also worth pointing out that the first term depending on e corresponds to the minimax 
separation radius in the case where the operator is known (i.e., u = 0), as displayed in Table 

ES 


Goodness-of-Fit 
Testing Problem 

ordinary-smooth 
aj ~ f 

super-smooth 
aj ~ exp{js} 

mildly ill-posed 

b, - r* 

^4s/(2s+2t+l/2) 

e2(lne-i)2i+V2 

severely ill-posed 
bj ~ exp{-jf} 

(In 

g.2s/ {s+t} 


Table 2.3: Minimax goodness-of-fit testing with known singular values: the separation rates 
for 0 < e < eo? ^0 £]0,1[, for all t,s > 0. 

The results displayed in Theorem 12.11 and Tables 12.1112.21 can also be understood as follows. 
Two problems are at hand: detection of the underlying signal (with a minimax separation radius 
that only depends on e) and detection of the ‘frequencies’ j for which the terms bj can be replaced 
by observations Xj without loss of precision (with a minimax separation radius that depends 
only on a). The final minimax separation radius is then the maximum of these two terms, i.e., 
the signal detection hardness is related to the most difficult underlying problem. We stress that 
such phenomenon has already been discussed in the minimax estimation framework, see e.g., 

m, ca. 
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3 Upper Bound on the Minimax Separation Radius 


In this section, we first propose an a-level testing procedure. Then, we investigate its maximal 
second kind error probability and establish a non-asymptotic upper bound on the minimax 
separation radius (which corresponds to item (i) of Theorem I2.ip . Finally, in Section [3.31 we 
provide a control of the upper bounds for minimax separation radii for the specific cases displayed 
in Table [2Tl 


3.1 The Spectral Cut-Off Test 

For a given 9q ^ 0, the aim of the goodness-of-fit testing problem (12.4p is to determine whether 
or not 6 = 9q. In particular, for any given j G N, one would like to infer the corresponding value 
9j from the observation {Y,X) = {Yj, Xj)j^^ from GSM (11.11) . Typically, for any given j G N, 
one may use the ‘naive’ estimate 9j of 9j, dehned by 


■.= ^ = ^9j + e^^,, jGN 








In order to ensure a ‘good’ approximation of 9j by 9j (in a sense which will be made precise later 
on), a precise control of the ratio bjjXj is required. To this end, we want to avoid coefficients 
for which Xj < u, namely for which the observation Xj is of the order of the corresponding 
noise level a, that does not have ‘discriminatory’ power . Therefore, we will restrict ourselves 
to coefficients Xj with indices 1 < j < M, where the bandwidth M is defined by 


M := inf{j G N : \Xj\ < ahj} — 1, (3T) 

where, for all j G N, 

I,, = (^^) + y/2to(^). (3.2) 

for some k > exp(l). 

Remark 3.1 The value of k is, in some sense, related to the value of the first kind error 
probability of the suggested testing procedure. We will see below that the value k = 5(37r^+12)/6 
is convenient to our purpose. We stress that n is not a regularization parameter: an ‘optimal’ 
value of K only allows to get ‘optimal’ constants in the final results but will not change the order 
of the corresponding minimax separation rates. Finding optimal constants is outside the scope 
of this work. 


The bandwidth M is a random variable but can be controlled in the sense that M G [Mq , Mi [ 
with high probability (see Lemma l6.ll for precise computations and Figure ITT] for a graphical 
illustration), where the bandwidths Mq and Mi are defined by 


j Mq := inf{j G N : bj < ahQj} — 1, 
|Mi := inf{j G N : bj < ahij}, 

and the sequences Hq = (/io,j)jGN) hi = (/iij)jgN satisfy 


(3.3) 


ho,j 

hi,j 



(3.4) 


(3.5) 







bj 



Figure 3.1: An illustration of the spatial positions of the bandwidths Mq and Mi, defined in Ii3.3\) . 
The decreasing solid curve corresponds to the values of the sequence b = (6j)jGN with respect to 
the index j E N, while the oscillating curve demonstrates one realization of the random sequence 
X = according to the GSM The increasing dashed curve draws the behavior of 

the sequence ahj. For the corresponding random ‘bandwidth’ M defined in Lemma \ 6.1\ 

shows that M E [Mq,Mi[ with high probability. 


for all j E N. The sequences h = ho = (/ioj)jgN and hi = in the definition 

of Mq, Ml and M allow a ‘uniform’ control of the standard Gaussian sequence p = 
(associated with X = for all 1 < j < Mi (see Lemmas 16.1116.21 and 16.31 in Section [6]). 


We are now in the position to construct a (spectral cut-off) testing procedure. According 
to the methodology proposed earlier in the literature (see e.g. m, m or m), our test will be 
based on an estimation of ||6* — 6*o|p. For any fixed D gN, consider the test statistic 


DAM . .2 

Td.m := E (^ - Oifi 


(3.6) 


Given a prescribed level a e]0, 1[ for the kind error probability, the associated spectral cut-off 
test is then dehned as 


^D,M : 

= 1{Td,M > ti-a,D{X)}, 


where 

DAM 

DAM 


ti_„,D(X) :=e2 ^ Xf + C{a)e\ 

y ] + (1 + i/a^a/2) 


1=1 \ 

1=1 



and 

C{a) = ‘i>^Xai 2 + 2x^/2 > 0, := ln(l/ 7 ) Vy e]0, 1[. (3.9) 

In other words, if the ’estimator’ T^^m of ||0 —0o|P is greater than the hxed threshold ti-a,D{X), 
0 and 9q are very unlikely to be close to each other, and we will reject Hq. 


Remark 3.2 Under Hq, Yj = bjOj^ -|- j E N, and, hence, 


DAM 


Td,m = ^ 
1=1 




-l\e,,o + eXT^i 


3 SJ 
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Therefore, the law of is not available and, thus, its corresponding (1 — a)-quantile is not 

computable in practice, since the sequence b = is unknown. However, Proposition 13.11 

below ensures that the threshold ti-a,D{X) defined in (j3.8p provides a computable upper bound 
on this quantile. 

First, we focus on the first kind error probability. The following proposition states that the 
spectral cut-off test '^d,m defined in (j3.7p - (|3.8l) . is an a-level test. 

Proposition 3.1 Let a €]0,1[ be fixed. Consider the goodness-of-fit testing problem 
Then, setting k = 5(37r^ -|- 12)/6, there exists ao G]0, 1[ such that, for all 0 < a < ao and for 
each e > 0, the spectral cut-off test defined in |g . is an a-level test, i.e., 

OLe,a{'^D,M) < (3.10) 

The proof is postponed to Section 16.2.11 

Remark 3.3 In order to shed light on the term (Tq, we provide bellow a heuristic argument. 
Note that, under Hq, thanks to a (rough) Taylor expansion, 

DAM 2 

TdM ^ X] ■ 

i=i 

Compared to the ‘noise-free’ case (i.e., ct = 0), we have in some sense to deal with the additional 
term abJ^Oj^orjj. Two scenarios are at hand 

• If supj bj^aj^ < Co, the expected amount of additional signal is 

DAM 

Y, bfe^^<a^Co\\ef, 

i=i 

which is of the order of the classical parametric rate However, since Cq is unknown, we 
use a rough standard deviation control on this additional term, which requires a logarithmic 
term (i.e., in the right hand side of (13.8p . We stress that this logarithmic term 

can be removed if the knowledge of Cq is assumed. 

• On the other hand, we can prove that abJ^rjj (see Lemma 16.411 is bounded with controlled 
probability, according to the construction of the bandwidth M given in (|3.1I) . In such case, 
the additional term can be controlled by the ‘bias’ 

Due to the additional logarithmic term mentioned above, the first kind error probability can be 
controlled as soon as a is small enough (i.e., 0 < u < cto for some (Tq G]0, I[). Unsurprisingly, it 
is impossible to retrieve any kind of information on the observations if the noise level a is too 
large. 

3.2 A Non-Asymptotic Upper Bound 

We now turn our attention to the the maximal second error probability. The following propo¬ 
sition provides, for each noise level e > 0 and for noise level a small enough, an upper bound 
for the separation radius r^^„{Sa, 4' d,m, P) of the spectral cut-off test Tdefined in (I3.6p - (|3.8I) . 
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Proposition 3.2 Let a, (3 g]0, 1[ be fixed, such that a < fi. Consider the goodness-of-fit testing 
problem ^2-4^ . Let be the speetral eut-off test, defined in Then, there exists 

(To G]0, 1[ such that, for all 0 < (T < (Tq and for each e > 0, 


rl^^{8a,'^D,M^I^) ^ C{a,l3)e^ 
where 


DAMi 


-2 


\ Z] r ln 3 / 2 (l/a) “DAMo 

N i=i 


C(a, fi) = 16(C(a) + 

The proof is postponed to Section 16.2.21 

Remark 3.4 According to Proposition 13.21 given a radius r^^^ > 0, then 


(3.11) 

(3.12) 


> C{a,f)e^ 
and, hence, 


DAMi 


A Z ^+(7+4yi)v^) p ln3/2(l/a) V 
\ i=i 


Ps,ai'^aire,a),^D,M) < fi, 


rl „ < inf 
DeN 


C{a,l3)e^ 


DAMi 


-2 


\ Z ^ K ln3/2(l/a) V “DAMo 

\ i=i 


Note that the upper bound on the separation radius ^(Tq, T d,m, fi) given in (I3.15P depends 

on two antagonistic terms, namely, a) V afy^Mo- Ideally, one 

would like to make this upper bound as small as possible, i.e., to obtain the weakest possible 
condition on \\9 — 0o|| such that, for any fixed fi g]0, 1[, (3,, ^{Qa{re,(i),^ d,m) < fi- Therefore, 
one would like to select D := H* such that 


D* := argmin 
Dm 


f 

DAMi 


1 C{a,l3)e^. 

Z ^ 4" (4 + 4.^Xq,/2) 

ct 2 ln3/2(l/a) 

1 \ 

1=1 



where C{a,j3) is defined in (13.1211 . However, this ‘optimal’ bandwith D* is not available in 
practice since the sequence b = (6j)jeN is not assumed to be known. To this end, we use instead 
the bandwidth D := III defined as 


: = 


arg mm 
DeN 


C{a, j3)£‘ 


i 


DAM 


^ A/ + (7 + ln3/2(l/a) V a 


^DAM 


(3.13) 


i=i 


The following theorem illustrates the performances of the corresponding spectral cut-off test 
'I'Dt,M) defined in (13.711 . with D := Dfi dehned in (13.1311 . 


Theorem 3.1 Let a, fi G]0, 1[ be fixed, such that a < fi. Consider the goodness-of-fit testing 
problem ^2.4^ - Let j^f be the spectral cut-off test, defined in {3. 71 ) with D := Dfi defined in 
Ii3.13\} . Then, there exists (Tq G]0, 1[ such that, for all 0 < (T < (Tq and for each e > 0, 


<^£,o-(4'Dt,M) — ® (3-14) 


and 




DAMi 




C{a,f3)e^ 

Z + (I" + 4-v/®o/2) 
1=1 

(T^ In3/2(1/CT) V 



where the constant C{a,fi) has been introduced in \3.12\) . 
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The proof of Theorem 13.11 is postponed to Section I6.2.31 

Remark 3.5 According to Theorem 13.11 given a radius > 0, then 


£,Cr — 


> inf 
Dm 


DAMi 


-2 


'^DAMo 

\ i=i 


C{a,l3)e‘^ 

^ ^Dt, m) — P: 


and, hence, 


f:„ < inf 
Dm 


e^a — 


C{a,l3)e'^ 

This upper bound corresponds to item (i) of Theorem \2. 1 


DAMi 


\ Y1 + {7 + A,/T^) pln3/2(l/a) 
N i=i 


(3.16) 


3.3 Upper Bounds: Specific Cases 

Our aim in this section is to determine an explicit value (in terms of the noise levels e and a) 
for the upper bounds on the minimax separation radius obtained in Theorem 13.11 above. 
To this end, we will consider well-known specific cases regarding the behavior of both sequences 
(aj)jgM and (6j)jgN- According to the existing literature, we will essentially deal with mildly 
and severely ill-posed problems with ellipsoids of ordinary-smooth and super-smooth functions 
(see also Section [2.21 for formal definitions). 


Theorem 3.2 Consider the goodness-of-fit testing problem |g..^[ ) when observations are given 
by and the signal of interest has smoothness governed by Then, 


(i) Ifh i ^ j ^) t > 0? 0 ,'nd ttj ~ , s > 0, for all j G N, then, there exists £Q,aQ g]0, 1[ such 
that, for all 0 < e < Eq and 0 < a < ao, the minimax separation radius re,a satisfies 


m < p2s+2t+l/2 v 

' £^<J ^ ^ 


a 


ln3/^(l/. 


cr 


2(fAl) 


(^^) Ifb, j ^ j ^, t > 0, and Oj ~ exp{js}, s > 0, for all j G N, then, there exists £q,(Tq g]0, 1[ 
such that, for all 0 < s < Eq and 0 < a < ao, the minimax separation radius he,a satisfies 

hl,<E^ [ln(l/e)](2'+5) vu2lni(l/(T). 

(Hi) If bj ~ exp{—jt}, t > 0, and aj ~ , s > 0, for all j G N, then, there exists Eo,ao g]0, 1[ 

such that, for all 0 < E < Eq and 0 < a < ao, the minimax separation radius he,a satisfies 

U%<[ln(l/e)]-^^V 


In 


aln^/\l/a) 


(iv) 


If bj ~ exp{—jt}, t > 0, and aj ~ exp{js}, s > 0, for all j G N, then, there 
Eo,ao G]0, 1[ such that, for all 0 < e < Eq and 0 < a < ao, the minimax separation 
he,a satisfies 


< 

S,C7 ~ 


2s 

gs+t V 


a 


lnV2(l/^)]2(fAl)_ 


exists 

radius 


The proof is postponed to Section 16.31 The main task is to compute the asymptotic 
off between both antagonistic terms 


^i=i “J _ 

bounds on the minimax separation radius he,a displayed in (13.1611 . 


.DAM, ^ 4 


(j2 ln3/2(l/a) 


in the 


trade- 

upper 
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4 Lower Bounds on the Minimax Separation Radius 

We establish a non-asymptotic lower bound on the minimax separation radius (which corre¬ 
sponds to item (ii) of Theorem EH). In order to do this, we consider two special cases of the 
GSM (|1.1|) . namely the situations where 

(a) e = 0: the signal is observed without noise but the eigenvalues of the operator at hand are 
still noisy, and 

(b) cj = 0: the ‘classical’ model (see, e.g., [TI] or [Hj) where the eigenvalues of the operator 
at hand are known. 

Both models (a) and (b) correspond to some ‘extreme’ situations but provide, in some sense, a 
benchmark for the problem at hand. We hrst establish a lower bound for the case (a) in Section 
14.11 and recall the lower bound for the case (b) (that has already been discussed in, e.g., [I], [H] 
or m) in Section 14.21 Then, we establish in Section 14.31 that the minimax separation radius 
associated to goodness-of-ht testing problem (12.4p is always greater than the maximum of the 
minimax separation radii associated to the cases (a) and (b). Finally, in Section [4.41 we provide 
a control of the lower bounds for minimax separation radii for the specihc cases displayed in 

Table EH 

4.1 Lower Bounds for a GSM with £ = 0 

We consider the GSM (jl.l|) with b = b and e = 0, i.e., 

Xj = bj + a 7]j, 

For a given sequence b = (6)jeN) dehne 

B{b) = {uG f{f^) : Co\bj\ < \uj\ < Ci\bj\, 

Given observations from the GSM (14.11) . for any 
following goodness-of-ht testing problem 

Hq : 6 = Oq versus Hi : Oq G £a, 

where Qa{ra) = G £a, WfJ-W > r^}- 

Our aim below is to provide a lower bound on the minimax separation radius ro,o-; dehned 
as 

:= _ inf, ro,c.(^a,^a,/3), 

where ro,o-(^a,'I'a,/?) is the separation radius of any given a-level test dehned as 
ro,CT(^a,^«,/3) := inf > 0 : (3(i^„ f,{Qaira),B{b),'^a) < P} , 
and /3o,o-,fe(0(^’(T), ■S(6), Tq) is the associated maximal second kind error probability, dehned as 

Po,a,b{&{ra),I3{b),'i>a) ■= SUp P 0 b(^a = O). 

9oS€a, 0 —(?o€©a(?'o-) 
beB{b) 

The following proposition states a lower bound for the minimax separation radius fo^o- of the 
goodness-of-ht testing problem (|4.2p . 


j G N, 0 < Go < 1 < Gi < -hoo}. 

given 00 / 0 and b E B{b), we consider the 

0-0oG0a(r.),5EB(6), (4.2) 
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Proposition 4.1 Assume that {Y,X) = (Yj,Xj)j^fq are observations from the GSM \4^ o,nd 
consider the goodness-of-fit testing problem Let a g]0, 1[ and ft G ]0,1 — a[ be given. Then, 

for every a > 0, the minimax separation radius fo^o- is lower bounded by 


\ C'a,/? r,_l -l] 

roo- > —:—a max On 
’ “ 4 i<d<M2 ^ ^ 


(4.3) 


where 


M 2 := sup < H G N : < 2 and G£)(C'o,C'l) > 


V^l + 4(l-a-/3)2 


(4.4) 


with 


1 rCibo r 1 'I 

Ca,/? = ln(l + 4(1 - a - f f) > 0 and Gd{Co, Ci) = — ■= / exp -^-^it - bnf \ dt, 

c7V27r Jcobo I 2cj J 

(4.5) 

/or some constants 0 < Cq < 1 < Ci < + 00 . 


The proof is postponed to Section 16.4.11 


Remark 4.1 Note that 


bo 


,t>D\ 


Gd{Co,C1) = (^(Ci - l)-^j - (^(Co - l)^j , 

where 4>(-) is the cumulative distribution function of the standard Gaussian distribution. Hence, 


GDiGo,Gl) > 


&£) > aK, 


a/ 1 + 4(1 - a - /3)2 
where K := K{Go,Gi,a, ft) > 0. Then M 2 in o can be re-expressed as 

M 2 := sup{Zl G N : &£) > a[K V Ga^g/2]} . 


(4.6) 


This expression M 2 in ra can be compared to the respective expressions of Mq and Mi defined 
in i3.3\) . In particular, we point-out that there is no logarithmic term involved in M 2 . 


4.2 Lower Bounds for the GSM when a = 0 

We consider the GSM dLH) with cj = 0, i.e., 

Yj = bjOj + efj, j G N, 

Xj = bj, j G N. 

Note that, in this case, the above model can be re-expressed as 

Yj = bjOj + efj, j G N, 
where b = {bj)j£n is a known positive sequence. 

The following proposition states a lower bound for the minimax separation radius defined 
in (j2.2p with ct = 0, of the following goodness-of-fit testing problem 

Hq-.O = 00 versus Hi : do e 8a, d - do e 0a(?’£,o), (4.9) 

where 0a(re,o) is defined in (12.31) with a = 0. 


(4.7) 

(4.8) 
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Proposition 4.2 Assume that Y = are observations from the GSM \4.8\ ) and consider 

the goodness-of-fit testing problem u-y\ )- Let a €]0,1[ and f5 g]0, 1 — «[ be given. Then, for 
every e > 0, the minimax separation radius lower bounded by 




D 

llo > sup 

^ A 


DeN 

\ 

j=i 


(4.10) 


where 

= (2 ln(l + 4(1 - a - /3)2))^4 > q. (4.11) 

The proof of the Proposition 14.21 with detailed arguments are related discussion can be found in 

e-g-, [I], [13 [T3 - 


4.3 A Combined Lower Bound 

The following result provides a lower bound on the minimax separation radius fg^o- for the 
goodness-of-fit testing problem (|2.4p . This lower bound corresponds to item (ii) of Theorem 

EH 


Theorem 4.1 Consider the GSMs (EH), (EIP and ra- Denote by fo,o- and r^^ the 
corresponding minimax separation radii. Then, for every e > 0 and a > 0, 


re,a > ro,cT V r^fi. 


(4.12) 


In particular. 


> 

£,<7 — 


16 i<i5<M2' 




I sup 

^ c-2 

^ A 

Den 



D 


'EY''' 


•-I 


(4.13) 


where Ca,p is given in li4-5\ ), M 2 is given in Ii4.4\ ) and Ca,p is given in {4-11^ 
The proof of Theorem 14.11 is postponed to Section 16.4.21 


Remark 4.2 At a first sight, the upper and lower bounds respectively displayed in (i) and 
(ii) of Theorem 12.11 do not exactly match up. However, a closer look at the involved formulas 
indicates that both quantities contain terms that have similar behaviors. This is, in some sense, 
confirmed in Section [Ql below where specific sequences (aj)jgN and (fej)jgN are treated. 


4.4 Lower Bounds: Specific Cases 

Our aim in this section is to determine an explicit value (in terms of the noise levels £ and a) 
for the lower bounds on the minimax separation radius f^,(j obtained in Theorem 14.11 above for 
the specific sequences (aj)jgN and considered in Section [3l3l 

Theorem 4.2 Consider the goodness-of-fit testing problem ^2.41 ) when observations are given 
by GJD, and the signal of interest has smoothness governed by 112.2\) . Then, 

(z) Ifb, j ^ j ^, t > 0? and aj ~ , s > 0, for all j E N, then, there exists £]0,1[ such 

that, for all 0 < £ < £0 and 0 < a < ao, the minimax separation radius satisfies 

> ^2s+2t+l/2 V (j2(fAl)_ 

£,(J rs_/ 
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(ii) Ifh ~ j ^, t > 0, and Uj ~ exp{js}, s > 0, for all j G N, then, there exists £o,ao g]0, 1[ 

such that, for all 0 < s < Sq and 0 < a < aQ, the minimax separation radius r^^^ satisfies 

(Hi) If bj ~ exp{—jt}, t > 0, and aj ~ , s > 0, for all j G N, then, there exists eo,ao g]0, 1[ 

such that, for all 0 < s < Sq and 0 < a < ao, the minimax separation radius satisfies 

(iv) If b. j ~ exp{—jt}, t > 0, and aj ~ exp{js}, s > 0, for all j G N, then, there exists 
So,ao g]0, 1[ such that, for all 0 < e < Eq and 0 < a < ao, the minimax separation radius 
satisfies 

The proof is postponed to Section [631 As in the case of the upper bound, the main task is 
to compute the trade-off between both different antagonistic terms involved in the lower bound 
on the minimax separation radius displayed in (I4.13p . 


5 Concluding Remarks 

The main conclusion of this work is that goodness-of-fit testing in an inverse problem setting is 
‘feasible’, even in the specific situation where some uncertainty is observed on the operator at 
hand in the model (HI]). We have established ‘optimal’ separation conditions for the goodness- 
of-fit testing problem (|2.4p via a sharp control of the associated minimax separation radius. 

We stress that several outcomes and open questions are still of interest. We can mention, 
among others, 

• Adaptivity: As proved in Theorem 13.II the test introduced in (|3.6p - (l3.9l) with 

defined in (|3.13l) is powerful in the sense that its separation radius is equal (up to constant) 
to the minimax one. However, this test strongly depends on the sequence a = (aj)jgN that 
characterizes the smoothness of the signal of interest. In practice, this sequence is unknown 
and adaptive procedures are necessary (see, e.g., [T2| or HU)- 

• Signal detection: We have already mentioned in Remark 12.21 that signal detection is 
different from goodness-of-fit testing (12. 4p when the GSM (|l.ip is at hand. In this work, 
we were concerned with the case where 9q ^ D (goodness-of-fit testing). However, some 
attention should also be paid in the future to the case where 0o = 0 (signal detection). In 
particular, testing methodologies and related minimax separation radii are quite different 
from those presented above. 

• Errors-in-variables model: Density model with measurement errors have been at the 
core of several statistical studies in the past decades (see, e.g., m for an overview). For¬ 
mally, given a sample of independent and identical distributed random variables (I^)i=i,2,...,n 
satisfying 

y) — Hi Ci i — 1 , 2 ,..., n, 

the aim is to produce some inference on the unknown density of the Xi denoted by /, 
the Ci corresponding to some error, with known density p. This appears to be an inverse 
(deconvolution) problem since the Yi are associated to the convolved density f * p- In a 
goodness-of-fit testing task, this model has been discussed in [2] and minimax separation 
rates (in the asymptotic minimax testing framework) have been established in various 
settings. In the spirit of our contribution, it could be interesting to propose methods 
taking into account some possible uncertainty on the density rj at hand. 
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All these topics require special attention that is beyond the scope of this paper. Nevertheless, 
they provide an avenue for future research. 


6 Appendix: Proofs 

6.1 Useful Lemmas 

The constant C > 0 and 0 < r < 1 below will vary from place to place. 

The following lemma is inspired by Lemma 6.1 of [6]. 

Lemma 6.1 Let M, Mq, Mi be defined as in (E2P-(E3) where a G]0, 1[ and n > exp(l) are 
fixed values. Define the event 

M = {Mo < M < Ml}. 


Then, for any a g]0, 1[, 


ry rvTT 


Proof of Lemma 16.11 It is easily seen that 


( 6 . 1 ) 

( 6 . 2 ) 


Ml 


P(M > Ml) = P inti Xj\>ahj}j < ¥ {\Xmi\ > crhMi), 

< ¥ {\bMi\ + cr\r]Mi\ > crhMi) , 

< ^ i\riMi\ > hMi — hi,Mi) 1 


= P ( |r/Mi| > ^/21n ( ^ 


where the sequences and {hij)j£^ are defined in (13.21) and (|3.5I) respectively. Using the 

bound 

'■+°° 1 e~^ 

e 2 dx <-^ Vx > 0, 


2vr J,, 


X ^/^ 


we get 


P(M > Ml) < 


2 a 


a 

< 


v^lO V^21n(10/a) 10 


since y^2 ln(10/a) > 1 for all a e]0,1[. In the same spirit, 


/ Mq 


Mq 


¥{M <Mo)=¥{(j{\Xj\<ahj}\ < ^P (|Xj| < a/i^), 


\i=i 


< 


i=i 

Mq 

^P(|6j| -a\r]j\ < ahj), 
1=1 
Mq 

< '^¥ {a\r]j\ > \bj\ - ahj)), 

i=i 

Mq 

^P(|r/j| >hoj-hj). 

1=1 


< 


(6.3) 

(6.4) 
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According to the respective definition of (/ioj)jeN (see (13.21) and p.4l) i. and using again 

inequality (|6.3p . we obtain 




< 


< 


Mo 


a 




2 ’ 


a 1 avr^ 

K ^ 7^ 
i6N“' 


6k ’ 


(6.5) 


on noting that p = 7r^/6. Since 

P(A4'=) < P(M < Mo) + P(M > Ml), 
the lemma follows, thanks to (16.41) and (16.5p . 


□ 


Lemma 6.2 Let M be defined as in (EJP and ^3-4^ where a G]0, 1[ and k > exp(l) are fixed 
values. Define the event 


M 


Then, for any a G]0, 1[ 


i=i 


Oi OfK 

P(S ) < TW + 


10 3k 

Proof of Lemma 16.21 Using the dehnitions of A4 and Mi, simple calculations give 

¥{B^) = P(.B=n A4)+P(.B^n A4^), 


( 6 . 6 ) 


(6.7) 


< p|^ U |cT|77,|>||j +P(A4'=), 

Mi-l X 1 \ 


Using ()3.5p . Lemma IHTTl and (|6.3p . we obtain 


P(5‘=) < 


O Ml 


1 


a avr 

<-^- 

“ 10 3k 


i=i J82ln(^5^ 
2 


a a avr 

2^ Kp 10 6k 


Hence, the lemma holds true. 


( 6 . 8 ) 


□ 


Lemma 6.3 Let 6 £ £a given. Let M he defined as in mD and {3.4^ where a G]0, 1[ and 
K > exp(l) are fixed values. Then, for any a g]0, 1[ and for any D gN, 

(DAM / , 

' ^ bn 


(^^-ij > fJ^ln^/^pi/fj) j < ^ ^ + 2 ) +Cexp{-lni+^(l/f7)}, 


for some C > 0 and 0 < r < 1. 
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Proof of Lemma 16.31 Using Lemma 16.11 Lemma 16.21 and a Taylor expansion as in Lemma 
6.6 of [B], we get, for all j < M, 


bj 1 1 


1 + abj ^rjj 


u-l I 2/--2 2 

bj Vj + Cj Vj, 
where < 86“^ on the even B dehned in ()6.6p . Hence 

/DAM / , 
bi 






^3 

( DAM 


^ “riAM 


< 


>AM 

E ^ ln3/2(l/a) 

i=i 

DAM DAM 

2a= E + 2<^‘ E S ‘“’''(I/' 

i=i i=i 


'cr) V 


“dam 


Therefore 

(dam 

He 


. ^ V X- “ ^ V ^ 

\ i=i ^ ^ 

DAM 


< 


O" 


/“) “dam 




DAM 

j=i 

( r DAM 

La- E > 2 

:= ri + r2 + p((Hn7W)H. 

We concentrate bellow our attention on the term Ti defined 

DAM 

^ 2 ^“OAM 

i=i 


n (HnM) 


n (HnM) I +F{{BnMy 


(6.9) 


as 


We consider the two following possible 
and (ii) cij^bj^ —)■ +oo as j +oo. 

Consider first scenario (i). Then, using again ([B] 


! scenarios: (i) Oj ^bj^ < Co 

and (ii) cij^bj^ —)■ +oo "" " ' ' — 


n (HnTW) 

as j —)• + 00 , for some Cq > 0, 




Ti < 


< 


< 


< 


|^2a2 


1 <™ ^“i N|) > ln3/2(l/fT) V n (H n M)^ 

L2cj 2 max (t??) > -cj^ ln3/2(l/cj)\ n (HCTW)^ 

l<j<DAM ^ 2 \ I Jj \ JJ 

r]j > ^ln3/4(l/a)^ , 


Mi-l 

E' 

i=i 

2Mi 2Co / Cln3/2(l/a)' 


j < (^exp{-ln^+^(l/CT)}. 

for some constants C, r G M'*'. A similar bound occurs for the 


( 6 . 10 ) 


I form TT^ 
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Consider now the second scenario (ii). Then 

u -2 „-2 ,2 


Ti < 


< 


1 -2 


(7^ max (rj^) > C C >1) 

l<j<DMV[ ^ 4 ' 


n (5n A4) 


Mi-l 


i=i 


< P ( CT^Tyl > 


since the sequence {hj)j^^ is non-increasing. Using (16.31) . we get 


Mi-l 

Ti < ^ P (r/j > ) , 

i=i 


< 


2Mi 2 
< Ml exp ( — In 


exp 


'U.Mi-l 


(^) 


^ ^ ^ CK 

< Ml X -^ < 


kM‘1 k 


By similar computations, we get 

DAM 


T2 := 


P ( S 2ct^ ^ Cj ln3/^(l/cT) V ^ I C (B C A4) 


i=i 


< P < 2 X 


DAM 'i 


n (BnA4) 


1, 


< P { <j 2 X 8^(7^ - 2 [> n (B n 7W) ) , 


Mi-1 


< 


< 


1 


J=1 

2 8V2M1 


\/^ h 


l,Mi 


exp 


hi,Mi-i 

1 

'4 X 82 


4 X 8^ In 


nMf 

a 


< 


a 


Hence, the lemma follows from Lemmas 16.1116.21 and (|6.9l) - (l6.12p . 


( 6 . 11 ) 


( 6 . 12 ) 


□ 


Lemma 6.4 Let 

Zj = Vj -|- j G N, 

where u = is a sequence of independent standard Gaussian random variables. For all 

D G N, define 

D D D 

T = Y,Zj and S = ^u| + 2^^ 

j=i j=i j=i 

Then, for all x > 0, 


2 2 


P ( T — E(T) > 2V^ + 2x sup (v^) ] < exp(—x) 

V i<j<D 


< exp(—x) 

(6.13) 

< exp(—x). 

(6.14) 
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Proof of Lemma 16.41 The proof is given in Lemma 2 of [T4] . 


□ 


6.2 Non-Asymptotic Upper bounds 
6.2.1 Proof of Proposition 13.11 

By definition, 


^6o,b{'^D,M = 1 ) = ^6o,b{TD,M > tl-a,D{X)). 

Conditionally to the sequence X = for each 1 < j < U A M, the random variable 

X~^Yj — 9jfi is Gaussian with mean Vj = {bjjXj — 1)9jfl and standard deviation Vj = £X^^. In 
particular, for all U G N 


^eo,b{'^D,M I X) := 

For all U G N, define 


DAM 




i=i 


U 


L',0 


A 


DAM 




DAM 


E (w-i) V- 


i=i 


(6.15) 


DAM 


DAM 


^D.M E F-+E ^74 ]r - M "?.»■ 

i=i i=i ^ 

Applying Lemma ElU with T = T^^m, 5] = and x = Xq ,/2 •= la(2/a), we get 

]P0o,6 ('^D,M — 1E6»o(^F',m I A) > 2Jy1e> MXa/2 + 2e^XQ,/2 ™ax (A“^) I a] < —. (6.16) 

y V l<j<DAM J I 

Using the inequalities Va + ^ < \/a + and o6 < o^/2 + 6^/2 for a,b > 0, it is easily seen that 


\/^D,M < 


DAM 


\ E u*+ 

^ i=i 


DAM 


^-EU(w-i) "1. 


< 


< 


DAM 




DAM 


max 

l<i<OAA/ 




i=i 


92 

U,o 


DAM 


DAM . , 

V A-^ + ^£2 inax Ar2 + i V ( - 1 

^ 2 i<7<dam 2 V Ai' 




92 

L,o- 


(6.17) 


According to (|6.15l) - (l6.17p . we obtain the following bound 


DAM 


6»o,fe 


Pd,m > (1 + 1/3^072) ^ 
7=1 


A. 


DAM 

1 ) E V + 

7=1 


a e 


DAM 




where the constant (7(0) is defined in (13.91) . Since E[E(U | W)] = E(U) for any random variables 
V and IF, the previous inequality leads to 


DAM 


9o,b 


Td,m > (1 + ydr)^) E 


— \Xi 

J = l \ 3 


DAM 

1 ) + E Xi^ + C{a)e 

7=1 


DAM 




-4 

7 


< 


a 
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Then, by defining 


A = 



< cr^ ln^/2(l/cr) V 


^DAM 


and applying Lemma l6.,'ll we immediately get 


< f + f + + Cexpj- ln^+^(l/o-), 

= ^ + ^(^ + 2))+Cexp{-l..‘-(lM 

for some C > 0 and 0 < r < 1. In particular, setting 



there exists do G]0, 1[ such that, for all d < do and for each e > 0, 

Q:£,o-(^d,m) < a- 

This concludes the proof of the proposition. 


□ 


6.2.2 Proof of Proposition 13.21 

Let 9, 6q G 6a and 9 — Oq ^ Qaif's,^)- Then 

^9,b{^D,M = ^) = iP6»,fe({'i'D,M = 0} n (5 n A^)) + = 0} n (5 n A^)'^) 


:= Ti + Ta. (6.18) 

Control 0 /T 2 ; Using Lemma l6.11 Lemma 16.21 and elementary probabilistic arguments, we get 

Ta :=P,,fe({'I/B,M = 0}n(^nAI)^) < F{{BnMr) 

< P(i3") + P(A^^) 


a 


a n 


fi , /3 


< ■n + -{—+2] <^ + '-{— + 2 


TT 


(6.19) 


since (5 > a. 


Control ofTi: Define tp/2,D{0^ to be the /3/2-quantile of Td,m, conditionally on X, i.e., 

Fe,b{TD,M <tp/ 2 M^,X) \X)<^. 

Then, by elementary probabilistic arguments, we get 

Ti ■= P6),fe({T£),M = 0} n n A^}), 

= E [P,,b {{^dm = 0 } I A) 1{B n AI}], 

= E[P,,b(7D,M <ti-a,D(A) I A)l{^nAI}], 

< ^F[l{ti.a.AX)<tp,2,D{0,X)]l{BCM]] 

+ E[l{ti_„,z)(A) >t^/ 2 ,D(^,^)}l{^nAI}], 

< ^+E[l{ti_„,D(A) >t^/2,z?(0,A)}l{^nAI}], 

< ^+Fe,b{{ti-o.,D{X)>tp/2,D{^,X)}c{BcM}). (6.20) 
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Our next task is to provide a lower bound for Under Hi, conditionally to the 

sequence X = {Xj)j^fi, for each 1 < j < D A M, the random variable X~^Yj — Oj^ is Gaussian 
with mean Vj and standard deviation Vj defined as 


X, 


— 1 ] 9j + {9j — 9jfi) and vj = eX, 


-1 


In particular, 


^e,b{TD,M \X) = 


Df\M r / 7 \ n 2 

^ “I" ~ 


i=i 

DAM DAM 


DAM 

i=i 


i=i i=i 


-2 


Let 


DAM 


DAM 


^D,M ■■= Y1 ^ 7 " + E 

i=i i=i 

DAM DAM 

i=i i=i 


-2 

j 




J J 


( 6 . 21 ) 


( 6 . 22 ) 


Using Lemma [63] with T = Td^m, E = ^d,m and x = x ^/2 •= lii(2//3), we obtain 

DAM DAM 


9,b 


Td,M < E E ^ “ ‘^\J^D,MXp/2 I -E < — 


/3 


i=i 

DAM 


i=i 

DAM 


^/3/2,d(^)-E) > ^ ^ Xj. ^ — 2\JY£),MXi3/2- 

i=i j=i 


Therefore, using (13.8p and ()6.23p . we get 

iP 0 , 6 ({U-a,D(^) > t/ 3 / 2 ,D( 0 ,2f)} n {5 n M}) 

DAM 

E ^ (^(“) + 


< 


i=i 


DAM 




-4 

i 




DAM 1 

Cj2 ln3/2(l/(j) 

+ '^^Xp/2. 

E 


DAM 


< 


where 


u]<C{a,p)e 


i=i 


DAM 


(6.23) 


E ^ In^/^l/f^) V n {B n M} I , 


C{a, j3) := C{a) + 3^®^, (6.24) 

and G(a) is defined in (13.911 . Note that, for any a, 6 E M, using the Young inequality 2ab < 
+ 7 “^ 6 ^ for 7 = 1/2 we get (a + 6 )^ > a ^/2 — b^. Applying the latter inequality with 


« = - ^j,o, b = [ ^ - 1] 9j, j = 1,...,D AM, 
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and using Lemma 16.31 we arrive at 


> t/3/2,D(0, ^)} n n M]) 

/ f DAM DAM 

I i V ('(9. - < 4C(ry.. /3 )e^ 


< n,b 1^1 ^ (Oj - 0,-,o)' < 4C(a,/3)e' 


-4 

j 


+ 4(1 + ^Xa/ 2 ) CT^ln^/^(l/a) 

(I 


DAM 


,-2 

'■DAM 


+ 2 ^ (^-1) 9 ]}n{BnM} 

i=i 


DAM 




\ 


DAM 


^ ^ + (6 + 4^^^) (j2ln3/2(l/cj) >n{^nA^} 


j=i 


+ |- + ^ (Y + 2) + Cexp{- 1„‘+A1A)}. 

Using the fact that 0 E ^a, we get 

¥e,b{{ti-aM^) > tp/2,D{^,X)} n{Bn M]) 


< P0,bN||0-0of<4C'(a,/3)+ 




DAM 


EV 


i=i 


+ (6 + 4^a:„/2) a2ln3/^(l/a) 

^ ®dam] + E {9j-0j,o?\n{BnM} 

j>DAM 

+f + ^ (y + 2) + Cexp{- lni+^(l/a)} 


< ^e,b\{\\e-eof <4C{a,P)e^ 


DAM 


, ^ ^ + (7 + 4yi;;;7^) p in3/2(i/CT) v 

>1 j=i 


-2 

^DAM 


] 




+f + ^(Y+2)+Cexp{-lni+^(l/a)}. 

To conclude the proof, note that on the event {.S n A4}, we have 

'2 


Mq < M < Ml and E 

Hence, using (16.251) and (I6.26p 

P0,fe({ti-«,D(X) > t^/2,D(^,^)} n {H n M]) 


Vj = 1 ,...,M. 


n{HnA 4 } 

(6.25) 

(6.26) 


< Pe,J 110-00 f < 16C(a,/3)e2 


DAMi 


A ^ ln3/2(l/fT) V 

^ i=i 


+f + H Y + 2 ) + Cexp{- lni+-(l/a)}. 


I + ; (t + + Cexp{- l.i‘+Al/<^)). 


as soon as 


||0-0of >C(a,/3)e2 


DAMi 


-2 


1 E +++'*++) r '"“'''(lA) V “DAMo 

\ i=i 


(6.27) 
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where C{a,(3) = 16(7(0,/3) is defined in (13.121) . Therefore, for any fixed (3 g]o, 1[, (|6.27I) implies 
that, there exists (Tq G]0, 1[ such that, for all 0 < cr < (Tq and for each e > 0, 

^e,b{^D,M = 0)<^ + -(^ + 2^+ (7exp{-ln^+^(l/cr)} < /3, 

10 K \ 2 ) 

for some (7 > 0 and 0 < r < 1, which, in turn, implies that (|3.15p holds true. The last part 
of the theorem is a direct consequence of (|2.6I) and (|3.15l) . This completes the proof of the 
proposition. 

□ 


6.2.3 Proof of Theorem 13.11 


The validity of (j3.14p can be immediately derived from Proposition 13.II taking into account that 
Lemma 16.31 is still valid with D := (that depends on the sequence X = {Xj)j^fq). For the 
proof of p3.15p . note first that (I6.18p . p6.19p and (16.201) still holds true with D := . In the 

same spirit, is is easy to see that Lemma 16.31 is still valid when the bandwidth D is measurable 
with respect to the sequence {Xk)ken- Hence, the same inequality than (I6.25p can be obtained 
with D := D\ namely 


< 


< 


= 0 , 


9,6({ii-„,Dt(^) > VADt(0,^)} n {HnM}) 
A I { ||0-0of <4C'(a,/3)e2 




^ + + pln3/2(l/(j) ^n{HnM} 


Fa \\e-eof < inf 

' dgn 


16(7(a, /3)e^ 


DAMi 


^ i=i 


as soon as 


110 — 0olP > inf 

dgn 


C{a,/3)e^ 


DAMi 


\ ^ In3/2(l/f7) V 

\ j=i 


where C{a,l3) is defined in (I3.12p . Therefore, we immediately get that (13.151) holds true.Finally, 
the validity of (13.161) follows immediately on noting that 


£,cr 


inf, A_^(Ta,4'a,/3) 

2 


— / 3 ) 

(7(a,/3)e2 


< inf 
dgn 


DAMi 


\ ^ p ln3/2(l/a) V 

\ i=i 


This completes the proof of the theorem. 


□ 


6.3 Upper Bounds: Specific Cases 

For the sake of convenience, we give the proof of each item (i)-(iv) in Theorem 13.21 in different 
sections. 
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Figure 6.1: [Case I: o-d^Mo ^ (I/o')] An illustration of the two resulting two terms (red 

color), namely and for each D ^ N, involved in the (upper bound of 

the) minimax separation radius (see Ild.lbV . where the bandwidths Mq and Mi are defined in 
(El). The bandwidth J* corresponds to the value J G N where the two dashed lines cross, i.e., 

J G N : ~ computation of the separation radius r^^a, for 0 < s < Cq, 

£o G]0, 1[ and 0 < a < ao, do G]0, 1[, leads to three different scenarios: J* < Mq < Mi (left 
figure), Mq < J* < Mi (eenter figure) and Mq < Mi < J* (right figure). 



Figure 6.2: [Case II: ln^'^^(l/iT)] An illustration of the two resulting two terms (red 

color), namely and for each L> G N, involved in the (upper bound of 

the) minimax separation radius (see /ld.l6\} . where the bandwidth Mi is defined in TI..d\) and 
the bandwidth M* is the value of M £ N such that the two terms afj and d^ln^/^(l/d) are of 
the same order, i.e., M G N : af^ ~ d^ln^/^(l/d). The bandwidth J* eorresponds to the value 

J G N where the two dashed lines cross, i.e., J G N : computation 

of the separation radius r^^o-, for 0 < £ < Eq, Sq G]0, 1[ and 0 < d < do, do G]0, 1[, leads to 
three different scenarios: J* < M* < Mi (left figure), M* < J* < Mi (center figure) and 
AI* < Ml < J* (right figure). 
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6.3.1 Case (i): Mildly ill-posed problems with ordinary smooth functions 

Recall that 

bj ~ t > 0, and aj ~ f, s > 0, j S N. 


(6.28) 


Proposition 6.1 Assume that the sequences b = {bj)j^^ and a = (aj)jgN ore given by ii6.28\) . 
Then, there exists eo,ao G]0, 1[ such that, for all 0 < s < Eq and 0 < a < ag, the minimax 
separation radius r^ „ satisfies 


^e,(T ^ e2®+2*+i/2 V crln^'^^(l/cr) 


2(fAi) 


(6.29) 


Proof of Proposition IHTTl In a first time, we determine the order of the bandwidths Mq and 
Ml. Setting 


Ml := ( f7'\/iln(l/cT) 


-i/t 


and Ml := ( a\l ^ In (l/cr) 


-i/t 


we get 


~ ^ In 1 < CTY'^ln(l/fT) ~ b^^, 


which implies that Mi > Mi. At the same time 


~ o-^ln(Mi) = o-J^ln(l/o-) - ^In ( ^ln(l/CT) ), 


2t V 2t 


= aJ 1 In (1/a) + 1 In (1/a) - ^ In hr (1/a) ), 


> 


f^\/^ln(l/a) ~ 6^^, 


which implies that Mi < Mi. Hence, we can conclude that 


Ml ~ ^ay^ln (1/a)^ 


-i/t 


Similarly, we get that 

Mq ~ ^ay^ln (1/a)^ 

In order to control the terms involved in the upper bound on the minimax separation radius, 
we consider the cases s < t and s > t separately. 

Consider first the case s < t. In this case, for all H G N, 

O'dImo > «Mo ~ ~ (<^ln^^^(l/o)) ^ > a2ln3/2(l/f7). 


Hence, 



DAMi 





DAMi 


E E + 

a^ ln3/2^1/a) 


< inf 
Dm 



L \ 

i=i 




1 \ 

i=i 
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Define now the value of J € N that satisfies the following equation 


^ £2 4^ J ^ e2.+24i/2, 

^i=i 

We now consider the following situations (see Figure (GD] for a graphical illustration): 


(J* < Mq) In this case, 


p2 < -2 < g.2s+2t+l/2 


• {J* ^ -^i) III this case, 


r ^ 
e,(T ~ 


inf 
dgn L 


-2 

DAMo 


< 

rsj 





crln^/^(l/cr) 


2s 


• (-^0 ^ J* ^ Ml) In this case. 




DAMi 

< inf 
e,o- ~ 


^ bj^ + a^^Mo 


i=i 


f 


DAMi 

1 r 


DAMi 

1 

< inf 

1 D<Mo 

A 

^ bj'^ + 

> A < inf 

D>Mo 


^ ^ + a^iAMo 


1 

L \ 

i=i J 

) y 

L \ 

i=i J 

J 



r 


DAMi 

1 

^ ®Mo ^ ■* 

inf 

D>Mo 

A 




[ 

L \ 

i=i J 

J 


< 


< 

rsj 


^Mo ^ ^ 


\ 


Mo 


^ + a 


-4 , -2 

Mo 


“Mo ~ 


cr 


J=1 

lni/2(l/, 


cr 


Combining the above terms, we immediately get 


f2 < r'2s+2T+l/2 V 

' /T ,-v , ^ 




(6.30) 


Consider now the case s >t. Dehne the value of M G N that satisfies the following equation 


a]^ ^ ^ M := M* ^ 


uln3/4(l/a) 


Hence, 



DAMi 





DAMi 


E C + 

ln 3 / 2 (l/cT) 


< inf 
dgn 


y ^ + ^DAM* 

L \ 

i=i 



L \ 

i=i 


Working along the lines of the case s <t, by replacing Mq by M* (see Figure E21), we get 


W crln^/^(l/cr) . (6.31) 

Hence, (|6.29l) follows thanks to (|6.3UI) and (|6.31l) . This completes the proof of the proposition. 
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6.3.2 Case (ii): Mildly ill-posed problems with super smooth functions 

Recall that 

bj ~ j~*, t > 0, and aj ~ exp{js}, s > 0, j G N. (6.32) 

Proposition 6.2 Assume that the sequences b = (6j)jgN a = (aj)jgN ore given by il6.S2\) . 
Then, there exists eo,ao G]0, 1[ such that, for all 0 < s < Eq and 0 < a < ag, the minimax 
separation radius satisfies 

fla ^ [In V Ini (l/a). (6.33) 

Proof of Proposition 16.21 According to Section 16.3.11 we obtain again 

Ml ~ ^(Ty^ln (l/cr)^ and Mq ~ ^cry^ln (l/cr)^ 


Then, for all H G N, 

«BaMo ~ «Mo ~ exp{-2Mos} ~ exp |-2s ' | < a). 

Define as in the previous case the value M G N that satisfies the following equation 

“m ~ ln^'^^(l/iT) 4^ M =: M* ~ - In 

Hence, 


1 

(Tln^/^(1/CT) 



DAMi 





DAMi 


E E + 

CT^ ln3/2(l/cT) 


< inf 
Dm 


7—4 —2 

/ . + “dam* 

L \ 

3 = 1 



[ \ 

i=i 


Define now the value of J G N that satisfies the following equation 




1 


~ exp{—2Js} J := J* ~ — In (1/e) — In 


\j=i 

We now consider the following situations: 
• (J* < M*) In this case. 


(iln(lA)) 


\ 2i+V 


[ln(l/e)](2*+i) . 


(J* > Ml) In this case. 


rla ^ [odam*] ^ Om* ~ Ini (l/a). 
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(M* < J* < Ml) In this case, 


< 

rs_/ 


inf 

dgn 



DAMi 


y + o-dam* 

L \ 
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DAMi 
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DAMi 

1 
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D<M* 


y, ^ + “dam* 


n 
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D>M* 


y ] ^ + “dam* 


1 

L \ 

i=i J 
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[ 

1 \ 

i=i 

J 
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DAMi 

< A < 

inf 

D>M* 


iz v^+“m* 


[ 

L \ 

i=i J 



r 

M* 1 

< A < 




1 \ 

.=1 J 


< 0^2 ~ fj^ln" (l/cr). 


Combining the above terms, we immediately get (Ib.S.ip . This completes the proof of the propo¬ 
sition. 


□ 


6.3.3 Case (iii): Severely ill-posed problems with ordinary smooth functions 

Recall that 

bj ~ exp{—jf}, t > 0, and aj ~ j®, s > 0, J G N. (6.34) 


Proposition 6.3 Assume that the sequences b = {bj)j^^ and a = (oj)jgM are given by 
Then, there exists eo,ao G]0, 1[ such that, for all 0 < s < Eq and 0 < a < ag, the minimax 
separation radius o- satisfies 


rt.<[ln(l/e)]-2^V 


In 


lni/2(i/ 


cr 


cr 


-2s 


(6.35) 


Proof of Proposition 16731 In a first time, we determine the order of the bandwidths Mq and 
Ml. Setting 


Ml := - In ( --7-- 

t Ulni/2(l/, 


and Ml := — In (1 /(t) , 
cr) / t 


we get 


^hi,Mi ~ fTv/ln(Mi) = fj 


/ 1 

In — In 


1 


which implies that Mi > Mi for cr small enough. At the same time 


< e = o-v^ln(l/a) ~ 6^^^, 


~ (-ln(l/c7) 

> b 




~ e ^ 1 * = cr. 


which implies that Mi < Mi for cr small enough. Hence, we can conclude that 

- In ( - -7- - I < Ml < - In (1/cr), 

t UlnV2(i/i7) - ' - t ^ 
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for a small enough. Similarly, we get that 


-In 

t 


lni/2(i/ 


a 


o) 


< Mo < -ln(l/cr), 


for a small enough. 


Now, we turn our attention to the proof of (|6.35l) . For all D E N, 

\ -\ -2s 


> -2 > 

^DAMo ~ “Mq ~ ^*^0 


In 
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lni/2(i/ 
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cr 




Hence, 


< inf 



DAMi 
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E "J- + 

ln^/^(l/a) 
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Dm 



L \ 

i=i 



1 \ 

i=i 


Define now the value of J E N that satisfies the following equation 


1 

, ^ bj^ ~ exp{2t J} ~ J := J* ~ - In (1/e) — In 

^ j=i ^ 

We now consider the following situations: 

• (J* < Mq) In this case, 


(t'"('/")) 


• (J* > Ml) In this case, 
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e,(T ^ 


inf 

neN 
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®DAMo 

^ -2 
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n -2s 


cr ln^/^(l/(T) 


• (-^0 ^ J* ^ Ml) In this case. 
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DAMi 
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DAMq 
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DAMi 
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D>Mo 
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i=i 


^Mo 
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1 -2s 
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Combining the above terms, we immediately get (16.3511 . This completes the proof of the propo¬ 
sition. 


□ 
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6.3.4 Case (iv): Severely ill-posed problems with super smooth functions 

Recall that 

bj ~ exp{—jt}, t > 0, and aj ~ exp{js}, s > 0, J G N. (6.36) 

Proposition 6.4 Assume that the sequences b = (6j)jgN a = (aj)jgN ore given by h6.S6[) . 
Then, there exists eo,ao G]0, 1[ such that, for all 0 < s < Eq and 0 < a < ag, the minimax 
separation radius satisfies 


fL<£*'V[aln'/2(l/,)]^(fAl), 

Proof of Proposition 16.41 According to Section 16.3.31 we obtain again that 


(6.37) 


-In ( -- 

t lcjln^/^(l/f7) 


< Ml < — In (l/fx) 


and 


for a small enough. Now, we consider the cases s < t and s > t separately. 


Consider first the case s < t. In this case, for all I? G N, 


p{-2sMo} > (alnV2(i/^))'*/‘ > a^lny\l/a). 


^DAMo ~ ®Mo ~ ' 


Hence, 


m < inf 
DeN 


\ 


DAMi 
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^DAMq, 
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Dm 
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DAMi 
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Define now the value of J G N that satisfies the following equation 
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. ~ ^ exp{2t J} ~ exp{2sJ} <;=^ J := J* ^ -In (1/e) . 

\ ■ 1 s A t 

\ j=i 


We now consider the following situations: 
• (J* < Mq) In this case, 


< (7,~ < £ s+t 

e,(J “J* ^ ■- 


(J* > Ml) In this case, 

-2 < inf 
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''DAMo 
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crln^/^(l/cr) 
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(Mq < < Ml) In this case, 
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Mo 
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^ i=l 


lni/2(i/a) 


Combining the above terms, we immediately get 


re,a ^ e'’+‘ V 


a 


lnV2(i/ 


cr 


(6.38) 


Consider now the case s > t. Define the value M E N that satishes the following equation 
^2 in3/2(i/|y) ^ M:=M*~-ln 


-2 
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ln3/4(l/a) 


Hence, 



DAMi 





DAMi 


E E + 

ln3/2(l/fT) 


< inf 
D& 


E 

L \ 

7=1 



L \ 
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Working along the lines of the case s < t by replacing Mq by M*, we get 


~9 ^ 


ulni/2(i/^) 


1 2 


(6.39) 


Hence, ()6.37l) follows thanks to ()6.38l) and ()6.39p . This completes the proof of the proposition. 

□ 


6.4 Non-Asymptotic Lower Bounds 
6.4.1 Proof of Proposition l47T] 

Let 6*0 E £a be given sequence (to be made precise below). Given a (prior) probability measure 
IT on the set associated with Hi, i.e., a probability measure vr on 0 a, 6 »o(^o-) b) := 0 a, 6 »o(^o-) S{b), 

where 0a,e»o(^o-) = 6 *o + Qaira), by standard Bayesian arguments (see, e.g., Section 3.1 of [T5]i. 
we arrive at 


l3o,a,b{&ira),t3{b)) = _ inf_ sup Pg^^(T„ = 0) 

: Q: 0 ,f 7 OoGEa^ ^ — 

bGB{b) 

> l-a-i(Eo[L2(y,X)]-l)V2, 


(6.40) 
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where L-^(Y, X) denotes the likelihood ratio between the two measures Ptt and Pq) IEq denotes the 
expectation with respect to Pq, withPo = g^{r^,b) ^eo,b dTT{9,b) andP^ = Je^g^(^r^^b) dTT{9,b), 

and the last inequality is obtained by standard calculations (see, e.g., Section 3.1 of [T5]l. 


The probability measure tt on &a,eo{i"(T,b) is selected as product probability measure, i.e., 

^ = n ^ ^ j G N. 

j&n 

Then, given the sequence 9 and the bandwidth H G N (to be made precise below), we set 


'^j,i — dojfi and '^j ,2 — dbji j 7^ dD^ 

and 

T^D,i = G~,^{CQ,Ci)5ej^ and d'KD, 2 {t) = exp |-^(t - df, 

where Gd{Cq, Gi) = {l/aV^) exp { — {t — 5£))^/(2(T^)} dt. In some sense, using the above 

product probability measure tt, we deal with observations {Y,X) = {Yj, Xj)j^f^ from the follow¬ 
ing Bayesian sequence model 


'^j = bjdjfi, Xj = bj + arjj, j G N \ {D}, 


and 

Yd = Bd9di Xd = Bd + cnjo, (6-41) 

where Bd Gaussian random variable with mean bD and variance that is independent of 
the standard Gaussian sequence {r/j}jgN- Note that 

7r(0a,0o(^^>^)) := T^{Qa,eo{ra) X B{b)) 

= '^i{&a,eo{ra)) X 7r2{B{b)) 

1 fCibo r 1 'I 

= G]j\Go,Gi )—=/ exp\-^{t-bDf\ dt (6.42) 

aV^TT Jcobo I J 

= 1. (6.43) 

In view of the above, it is immediately seen that 

L^{Y,X) = n L^^{Yj,Xj) = L^^{Yd,Xd). 
jen 

Hence, as before, we arrive at 

/3o,.,fe(e(r,,),H(6)) > 1 - a - ^{Eo[Ll^iYD, Xd)] - (6.44) 


Our task below is then to provide an upper bound on ^{Yd, Xd)]- To this end, it is easily 

seen from model (|6.4ip that Zd = {Xd-,Yd)-, H G N, is Gaussian random vector with mean Uq^d 
and covariance matrix where 


Note that 


Ue,D 


bD \ 

bD9D )’ 


^B,D — 


2 9d '\ 
Od 9l )■ 


y-l — _ 

r\ — 




01 


0l 

-9d 


-9d 

2 
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and 


{Zd-U e,D)''^o^j:){ZD-U q^d) = -^{Xd - bD,yD - ^dOd) 2 


01 

= -^{Xd — bD,YD — bD0D) 
Od 


-9d 


Xd — bo 
Yd — bD0D 


1 

1 


{Xd — bo,Y d — bDdn) 


0‘d{Xd — bD) — 0 d{Yd — bDdn) 
—9d{Xd — bD) + 2(Yd — bD9D) 

Xd91 - Yd9d 
2Yd — bD9D — Xd9d 


= — bD){XD9jj — Yd9d) + {Yd — bD9D){‘ZYD — bD9D — Xd9d)) 

Od 


1 


[{Yd — Xd9d)^ + (Yd — 


Hence, 


Ltto{Xd) = exp ^{Zd — Udg^DYcr ’^'Zq^j^{Zd — Uq^^d) — {Zd — Uq^d)' o' ’^'Zq^j^{Zd — Uq^d)'^ 


= ^ 


{Yd — Xd9d^^ _I_ (Yd — bD9Dfl)‘^ {Yd — Xd9d)‘^ {Yd — bD9D)^ 


= exp 




2YB 


'^D,0 


(52 02 
Yd,o 


fl2 

'^D,0 


- 2XdYd 


1 


1 


= ^ 


2y, 


D 


— I — 2Yd{Xd + bD) 


9d,o 9d 

1 


fl2 02 

Yd,o 


6»2 


— 2bDYD 


1 


1 


1 


9d,o Od 


9Dfl 9 d 


Under Hq, Yd = Bd9d,o- Therefore, conditionally on Bd, 


Eo[lI{Zd)] = G^\Co,Ci)E 

= G^\Co,C,)eL 


exp < 2Bf) 1 - 




0d,o 

01 


— 2Bd{Xd + &d) ( 1 — 


^D,0 

9d 


X E 


exp 


exp I 
4.BdXd 


Ct2 


1 - 


cr^ 


1 - 


9d,o 

9d 


0? 


D,0 1 ^BDbD 


01 


CJ^ 


1 - 


^D,0 

9d 


Bd 


:= G-^\Co,GI)E{Eo[lI{Zd)\Bd]). 

Using the formula 

E [exp(-(Ai + A 2 U)] = exp(-Ai + A 2 / 2 ), Ai, A 2 G 
for any standard Gaussian random variable V, with 


(6.45) 


A, = 




1 - 


^D,0 

9d 


we arrive at 


f 4^2 / 

Eo[lI{Zd)\Bd] = exp<^^(l- 


A 2 — 


0d,o 
01 . 


4Hz) 


a 


1 - 


9d,o 

9d 


^Bd 




1 - 


9Dfi 

9d 


{Bd + 6d) 


X exp 


C72 


1 - 


^D,0 

9d 


= exp{cj ^bI [4(1 - pjj) - 4(1 - p) + 8(1 - pd)‘^] } 

X exp{-4fT“^HD6p(l - pp)}, 
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where 


PD = 1 - 


Opfl 

Od 


Using simple algebra, we get 


lEo I -Bd] = exp |-^^(pd - 1 )(pd - 2 )- ~ 

= exp |^(pD - l)[S|)(pD - 2 ) + 5dM| • 

It is easily seen that 

B‘d{pd —‘^) + Bohn = (^d + <7i?D)^(pD — 2 ) + (^^ + o-77D)feD 

= ^d(pd - 1) + 2afiDbD{pD - 3/2) + a‘^fj]^{pD - 2), 

where {fjojoen is a sequence of independent standard Gaussian random variables. Therefore, 


'^o[lI{Zd) \ Bd] = exp |-^(1 - 


a 


X exp -boVDipp - 1) PD - + 4Pd(pd - 2) 


Since pD G] 1 , 2 [, then Afjj^{p£) — 2) < 0 and, hence, 

1^0 [BliZo) I B^)] < exp |-^(1 - Ppf' + —bpfjDipp - 1 ) ^Pd “ 2 ) } ' 


Using (|6.45p with 


we get 


Ai = 0, A 2 = —bnipp — 1) ( Pd — 


a 


2 ’ 


Eo[lI{Zd)] = G-^\Co,Ci)E{Eo[lI{Zd)\Bd]) 

< G))^(C'o,C'i)E (^exp|^(l + ^boppipp - 1) (^pp - 


= G^^(C'o,Ci) exp <( ^(1 - p^) 






1 + PD - 


< G^^(Go,Gi) exp 1^(1 -pd)2| 

< l + 4(l-a-/3)2. 


as soon as 


56? 


D 




(1 - PD? < ln(l + 4(1 - a - /3)2) + ln(G(Go, Gi)), 


or, equivalently, as soon as 


where 


-1 


\Gp - 0p,o\ < C'o,p,D <7 |Pd|6^ 


G„,p,d = ln(l + 4(l-a-/3)2) + ln(Gfl(Go,Gi)) 

:= G,,p + ln(Gz)(Go,Gi)). (6.46) 

(Note that, according to (14.411 . for all D < M 2 , Ca,p,p > Ca,p/2.) 
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Choice of 9\ The sequence 6 = {9j)j^^ is chosen as follows 


^3 = 


0 ifj/A 

«Z)V2 if j = D. 


It can be easily seen that 9 E 

Choice of 9o: The sequence 9o = (%,o)jgn is chosen as follows 

'o ifj/A 

a^V2 + 12 if j = D. 


^i,o - 


Note that 9^ E £a as soon as 


Ca,f},D — 1 - 


(6.47) 


Indeed, using the standard inequality {x + yf < 2{x^ + y^), for x, y E M, we immediately get 


-2 


— ®Z)^D,0 ^ + ‘^Ca,l3,D 


2 „-2 


(T a 


D 


JGN 


61, 4 




cr 


< 1 , 


2 ' '^“’^’^ 261 , ^ 


(6.48) 


as soon as (16.471) is satisfied. Furthermore, as soon as (16.471) is satisfied, it is easily seen that 

9 — 9 q ^ £a- 


Moreover, for the specific choices of 9 and 9 q given above, it is immediately seen that 
\0d - 0d,o\ = Ca,l3,D ^ 11^* - ^oll = 




In other words, we have proved that for all Z) E N satisfying (|6.47p then 

l3o,a,b{Q{ra,D),B{b)) > (3, where ab]j^a^^, 

for any given /? e]0, 1 — a[. This implies that, for every p > 0, /3o,(T,f)(0(p), ■S(6)) > /3 as soon as 

c 

p < ah~j^a^ for some D gN : Ca, 0 ,D — f’ 


which holds, as soon as 


P < ab~j^a~j^ for some 1 < D < M 2 , 


on noting that 

M 2 := sup < ZD E N : Ca^p(T\h~j^\ < 2 and Gd{CojC1) > 


■\/l + 4(1 - a - /3)2 j ’ 


and that 


Co^AD > 1 < ZD < M 2 . 


In particular. 


Hence, 


/3o,a,biQ{p),l3ib)) > (5 for all p < a rnax [6^^a^^]. 


\ C'a,/? r,_l _li 

?’o ,(7 > —<7 max 6,, . 

’ 4 i<d<M 2 


This completes the proof of the proposition. 


□ 
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6.4.2 Proof of Theorem 14.11 

The proof is splitted in two parts. We first show that and then show that fe,a > 

Consider observations Y = from the GSM (|4.8p . Introduce the following goodness- 

of-fit testing algorithm: 

• Generate a sequence X = {Xj)j^^ according to the GSM 

Xj = bj + afjj, j E N, (6.49) 

where fj = is a sequence of independent standard Gaussian random variables 

(that is also independent of the sequence ^ (Note that the GSM ()6.49p is an 

independent copy of the second equation in the GSM (jl.ip .) 

• Let Ta := Tct(T, be a given (non-randomized) a-level goodness-of-fit testing procedure 
based on observations {Y,X) = (Yj, Xj)j^f^ from the GSMs (14.81) and (|6.49p . 

• Define the randomized test Tq, := TaPTjl as 

T«(y) :=E[T« I y], 

where E[-] refers to expectation with respect to the independent standard Gaussian se¬ 
quence fj. 

In particular, for every e > 0 and u > 0, the randomized test is an a-level test. Indeed, 




since To is an a-level test. 


E,„,fe[E[To I y]] 

E6lo,6(^a = !) = «) 


(6.50) 


Let 9 E P{N) and 9 
satisfies 


00 £ be fixed. Then, the associated second kind error probability 


E,,fe(l-To(y)) = E,,fe(l-E[To I y]) 

= E0,fe(l-To) 

= P0,6(To = 0) < /3, (6.51) 

as soon as 

||0 - 0o|| > re,cr(Ta,To,/3). 

This implies that for any a-level goodness-of-fit testing procedure Tq,, based on observations 
(y, X) from the GSMs (|4.8p - (l6.49p . we can associate an a-level goodness-of-ht testing procedure 
To, based on observations Y from the GSM (j4.8l) . such that the separation radius of T^ is 
smaller than the separation radius of T^, i.e., 

r£,o(^^a,To,/3) < re,o(^^a,To,/3). 

measurable function of the observation Y = (y)jgp[ from the GSM (14.811 with values in the interval [0,1]: for 
any given radius p > 0, the null hypothesis is rejected with probability 4a (T) and it is not rejected with probability 
1 - Ta(T). In this case, oiefTa) := Eej,,(.(4a(y)) and f3^{Oa{p), Ta) := supg^gg^^ Eg,6(1 - TafT))). 
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Hence, it is immediately seen that, for any a-level goodness-of-fit testing procedure based 
on observations (H, X) from the GSMs (|4.8p and (|6.49p . 


re,0 ■= inf refl{£a,'^a,P) 

ae,o{'^a)<a 

< rs,o{£a,^a,P) 

< re,a{£a,'^a,P), (6.52) 


implying that 

r£,o < re,a- 

The proof of the assertion 

f'o,<T < re,a- 

follows similarly, along the lines of the proof of the previous assertion, and it is therefore omitted. 
This completes the proof of (I4.12p 


Finally, (|4.13l) follows immediately form (|4.12l) . taking into account (|4.3p and (|4.10l) . This 
completes the proof of the theorem. 

□ 


6.5 Lower Bounds: Specific Cases 

For the sake of convenience, we give the proof of each item (i)-(iv) in Theorem 14.21 in different 
sections. 


6.5.1 Case (i): Mildly ill-posed problems with ordinary smooth functions 

We assume that (|6.28l) holds true, i.e., 

bj ~ t > 0, and aj ~ j®, s > 0, j G N. 


Proposition 6.5 Assume that the sequences h = and a = (aj)jgN o,re given by i6. 28\} . 

Then, there exists eo,crQ G]0, 1[ such that, for all 0 < s < Eq and 0 < a < ao, the minimax 
separation radius rs,a satisfies 

rla ^ e2'>+2*+i/2 V (6.53) 

Proof of Proposition lUTSl For the second term in (I4.13p . it is known that (see [U], [TT]1. 


sup 

DeN 



D 

Cq:,/3 £ A 

^bj^ A 

L \ 

i=i 


^ £2s+2t+l/2 _ 


Consider now the first term in (j4.13p . If s > t, then the sequence {bj }jgN is non¬ 


increasing and, thus. 


■ cr^ max \ba rfi] ^ . 


On the other hand, if s < t, then the sequence {bj ^Uj }jgis} is non-decreasing. Hence, thanks 

to g2D, 

and, thus, 

fi2 

2 


~ b\[^ M 2 ~ fj 


2 r ,-2 - 2 i 2 t -2 -2 -2 ^ 

(J m&tX 0/-) CL f) (J 0 nf CL Ti/T CL Ti/T (J ^ . 

16 i<d<M2^ d d i M 2 M 2 M 2 

Combining the above terms, we arrive at (|6.53p . This completes the proof of the proposition. 


□ 
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6.5.2 Case (ii): Mildly ill-posed problems with super smooth functions 

We assume that (|6.32p holds true, i.e., 


bj ~ j t > 0, and Uj ~ exp{js}, s > 0, j G N. 

Proposition 6.6 Assume that the sequences b = {bj)j^f^ and a = {aj)j^fq are given by Ih. 3^) . 
Then, there exists eo,ao G]0, 1[ such that, for all 0 < s < Eq and 0 < u < a^, the minimax 
separation radius rs,(T satisfies 

f,%>e2[ln(l/e)](2*+5) (6.54) 

Proof of Proposition lUTBl For the second term in (I4.13p . it is known that (see [U], [H]), 


sup 

dgn 



D 

2 

A 


L \ 

i=i 


[ln(l/e)](^*+5) . 


Consider now the first term in (I4.13p . Then, the sequence {b^ ^Oj is non-increasing for 

each s,t > 0, and, thus. 


16 


rr-2 -2i 2 

max On On ~ <7 • 
1<D<M2 ^ ^ 


Combining the above terms, we arrive at (j6.54p . This completes the proof of the proposition. 


□ 


6.5.3 Case (iii): Severely ill-posed problems with ordinary smooth functions 

We assume that ()6.34p holds true, i.e., 

bj ~ exp{—jt}, t > 0, and Oj s > 0, i G N. 


Proposition 6.7 Assume that the sequences b = {bj)j^^ and a = (aj)jgN ore given by ^6.34^ . 
Then, there exists eo,ao G]0, 1[ such that, for all 0 < s < Eq and 0 < a < o-q, the minimax 
separation radius he,a satisfies 

f,%>[ln(l/5)l-"*V|lii(l/<r)|-=‘. (6.55) 

Proof of Proposition [6771 For the second term in (I4.13p . it is known that (see [2], [TT|i. 


sup 

dgn 



D 

^ c-2 

^ A 


[ \ 

1=1 


[In (1/e)] 


-2s 


Consider now the hrst term in (14.131) . Then, the sequence {bj is non-decreasing. 


Hence, thanks to (14.41) . 

and, thus, 

(^2 


1 


o ~ ^2 ~ - In (l/o) 


l-2s 


16 ■ ~ ^ ~ ~ [In (l/o)]' . 

Combining the above terms, we arrive at (I6.55p . This completes the proof of the proposition. 


□ 
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6.5.4 Case (iv): Severely ill-posed problems with super smooth functions 

We assume that (|6.36p holds true, i.e., 

bj ~ exp{—jt}, t > 0, and aj ~ exp{js}, s > 0, J G N. 


Proposition 6.8 Assume that the sequences b = {bj)j^f^ and a = {aj)j^fq are given by i6.36\) . 
Then, there exists eo,ao G]0, 1[ such that, for all 0 < s < Eq and 0 < u < a^, the minimax 
separation radius rs,(T satisfies 


re,a >£'>+* Vo- 


2(fAl) 


(6.56) 


Proof of Proposition [6781 For the second term in (I4.13jl . it is known that (see [2], [TT|h 


sup 

DeN 



D 

2 

Cq:,/3 ^ A 

^bj^ A 

L \ 

i=i 


2s 

rvj ^ s+t 


Consider now the first term in (j4.13h . If s > t, then the sequence {bj is non¬ 


increasing and, thus. 




2 ie-2 -2^ 

a max J ~ a 


16 i<d<M2 


On the other hand, if s < t, then the sequence {bj ^a- is non-decreasing. Hence, thanks 

to gai), 

and, thus. 


(T ~ b%j M 2 ~ - In (l/a) 




- 2 - 2 i _ 2 i- 2„-2 -2 


max ] ~ 




Combining the above terms, we arrive at (|6.53p . This completes the proof of the proposition. 


□ 
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